Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing

نویسندگان

چکیده

Multi-access Edge Computing (MEC) has recently emerged as a potential technology to serve the needs of mobile devices (MDs) in 5G and 6G cellular networks. By offloading tasks high-performance servers installed at edge wireless networks, resource-limited MDs can cope with proliferation recent computationally-intensive applications. In this paper, we study computation problem massive multiple-input multiple-output (MIMO)-based MEC system where base stations are equipped large number antennas. Our objective is minimize power consumption delay under stochastic environment. To end, introduce new formulation Markov Decision Process (MDP) propose two Deep Reinforcement Learning (DRL) algorithms learn optimal policy without any prior knowledge environment dynamics. First, Q-Network (DQN)-based algorithm solve curse state space explosion defined. Then, more general Proximal Policy Optimization (PPO)-based discrete action introduced. Simulation results show that our DRL-based solutions outperform state-of-the-art algorithms. Moreover, PPO exhibits stable performance efficient compared benchmarks DQN Double (DDQN) strategies.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Mobile Edge Computation Offloading Using Game Theory and Reinforcement Learning

Due to the ever-increasing popularity of resourcehungry and delay-constrained mobile applications, the computation and storage capabilities of remote cloud has partially migrated towards the mobile edge, giving rise to the concept known as Mobile Edge Computing (MEC). While MEC servers enjoy the close proximity to the end-users to provide services at reduced latency and lower energy costs, they...

متن کامل

Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning

To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is emerging as a promising paradigm by providing computing capabilities within radio access networks in close proximity. Nevertheless, the design of computation offloading policies for a MEC system remains challenging. Specifically, whether to execute an arriving computation task at local mobile dev...

متن کامل

Price-Based Distributed Offloading for Mobile-Edge Computing with Computation Capacity Constraints

Mobile-edge computing (MEC) is a promising technology to enable real-time information transmission and computing by offloading computation tasks from wireless devices to network edge. In this study, we propose a price-based distributed method to manage the offloaded computation tasks from users. A Stackelberg game is formulated to model the interaction between the edge cloud and users, where th...

متن کامل

Computation Rate Maximization for Wireless Powered Mobile-Edge Computing with Binary Computation Offloading

Finite battery lifetime and low computing capability of size-constrained wireless devices (WDs) have been longstanding performance limitations of many low-power wireless networks, e.g., wireless sensor networks (WSNs) and Internet of Things (IoT). The recent development of radio frequency (RF) based wireless power transfer (WPT) and mobile edge computing (MEC) technologies provide promising sol...

متن کامل

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Ad hoc networks

سال: 2023

ISSN: ['1570-8705', '1570-8713']

DOI: https://doi.org/10.1016/j.adhoc.2022.103080